Section: Partnerships and Cooperations

European Initiatives

• Title: Semantic Evaluation At Large Scale

• Type: CAPACITIES (Infrastructures)

• Defi: Scientific Data Infrastructure

• Instrument: Combination of COLLABORATIVE PROJECTS and COORDINATION and SUPPORT ACTIONS (CPCSA)

• Duration: June 2009 - June 2012

• Coordinator: Universidad Politecnica de Madrid (ES)

• See also: http://seals-project.eu

• Abstract:

Exmo is a partner of the seals European commission infrastructure project whose goal is to provide the infrastructure for evaluating semantic technologies. Jérôme Euzenat has been vice-coordinator in charge of the research area.

More particularly, Exmo has been in charge of providing an infrastructure for evaluating ontology matching systems and algorithms, to be aggregated in the seals platform. This task involves:

• designing evaluation campaigns, including identifying criteria, metrics, datasets, and tools to be used in each campaign,

• designing and implementing services for automatic evaluation of systems and algorithms,

• analysing the results of evaluation campaigns and using them to produce detailed reports on both the effectiveness of the testing methodologies, and the systems that have been tested.

This year we have prepared the second seals evaluation campaign and designed a fully automated evaluation process (see § 6.1.1 ).